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Abstract 


In  a  previous  paper  [A  multivariate  notion  of  association,  with 
a  reliability  application]  random  variables  were  defined 

to  be  associated  if  each  pair  of  non-decreasing  functions  FCT^.T^ . Tn) , 

G(T^,T2». . .  ,Tn)  have  a  non-negative  covariance.  The  properties  of  this 

definition  were  studied  in  the  case  that  . are  finitely 

discrete,  and  a  sample  application  to  reliability  theory  was  discussed. 

Ir  the  present  paper  several  equivalent  definitions  of  the  same  notion  of 
association  for  unrestricted  are  treated.  The  properties 

previously  obtained,  i.e.  that  association  is  preserved  under  the 
operations  of  extracting  subsets,  pooling  independent  sets,  and  forming 
sets  of  non-decreasing  functions,  are  shown  to  hold  in  general.  In 
addition,  association  is  shown  to  be  preserved  under  limits  in 
distribution.  Some  additional  applications  of  association  are  discussed, 
e.g.  previously  published  results  of  A.  W.  Kimball  and  H.  Robbins  are 


obtained. 
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1.  Introduction 


In  a  previous  paper  [1]  we  studied  a  notion  of  multivariate 
association  for  random  variables  using  the  definition 

(1.1)  Random  variables  T, ,T_,...,T  are  associated  if 

l  i  n 

Cov[F(T) ,G(T) ]  >  0,  where  T  -  (T-,T_,...,T  ),  for  all 
~  ~  —  **  i  /  n 

pairs  F,G  of  non-decreasing  functions, 

where  F  non-decreasing  means  F(s)  <_  F(£)  whenever  s.^  < 
i“l,...,n.  We  considered  only  the  case  in  which  the  random  variables 
Tl*T2,#,,»Tn  are  finitely  discrete,  i.e.  take  a  finite  number  of  values. 
For  such  variables  the  expectations  EFQ) ,  EG(T),  and  EFQ)G(£) 
involved  in  Cov[F(T)  ,G(£)  ]  always  exist,  and  (1.1)  is  consequently 
a  well-behaved  definition. 

We  showed  in  the  finitely  discrete  case  that  association  has  a 
number  of  fundamental  properties: 

(pp  Any  subset  of  a  set  of  associated  random  variables  is  also  a 
set  of  associated  random  variables. 

(P2)  If  two  sets  of  associated  random  variables  are  independent  of 
one  another ,  then  their  union  is  a  set  of  associated  random 
variables. 

(P^)  The  set  consisting  of  a  single  random  variable  is  associated. 
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(P^)  If  . ,Tn  are  associated,  then  any  set  of  non-decreasing 

functions  (T) ,  S2  (T)  , . . . ,  Sm  (T)  are  associated. 

Some  discussion  of  the  implications  of  the  properties  of  association, 
and  a  sample  application,  are  given  in  [1].  The  purpose  of  the  present 
paper  is  to  consider  several  "well-behaved"  definitions  of  association  for 
general,  l.e.  unrestricted,  random  variables,  and  to  show  that  they  are 
equivalent;  to  show  that  properties  P^,  P2,  P^,  and  P^  hold  in  the  s 

general  case,  and  to  obtain  the  additional  property 

(P5)  If  Ti^  .T^,  •  •  •  ,1^  are  associated  for  each  k  and 

-*>  S  -  (S- ,S0, . . .  ,S  )  in  distribution,  then  S,,S„,...,S 
~  i.  t  n  l  1.  n 

are  associated; 

and  finally  to  indicate  that  a  suitably  qualified  version  of  (1.1)  could 
be  used  as  a  definition  of  association  in  the  general  case. 

V 

2.  Equivalent  definitions  of  association  for  general  random  variables 

Perhaps  the  most  elementary  way  to  define  association  for  unrestricted 
random  variables  is 

(2.1)  Random  variables  . are  associated  if  Cov [ T (T) , A (T) ]  _>  0 

for  all  pairs  r,A  of  binary,  non-decreasing  functions. 

In  [1]  definition  (2.1)  is  shown  equivalent  to  definition  (1.1)  for  finitely 


discrete  random  variables. 
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We  will  also  consider  the  definition 

(2.2)  Random  variables  T,,Tn,...,T  are  a880ciated  if 

l  &  n 

Cov[U(£)  ,V(£)  ]  0  for  all  pairs  U,V  of  bounded,  continuous, 

non-decreasing  functions. 

Finally  we  introduce,  for  each  random  variable  and  fixed  t, 
the  binary  indicator  variable  X^(t)  such  that  X^(t)  ■  1  if  >  t, 
X^(t)  "0  if  T  <_  t.  We  then  consider  the  definition 

(2.3)  Random  variables  T^,T2,...,T  are  associated  if,  for  every 
choice  of  k  and  tpt2, . . .  ,tk»  the  binary  random  variables  in 
the  array 

x1(t1)  xx(t2)  •••  xx(tk) 
x2(tx)  x2(t2)  •••  x2(tk) 


W  W  -  W 


are  associated  according  to  (2.1). 


Property  is  an  Immediate  consequence  of  each  of  the  definitions 

(2.1),  (2.2),  and  (2.3).  The  proof  of  property  P2  given  in  [1]  can  be 
applied  to  show  it  holds  for  each  of  (2.1),  (2.2),  and  (2.3).  In  [1] 
property  P^  was  proved  for  definition  (2.3).  The  proof  of  property  P^ 
given  in  [1]  applies  to  show  that  it  holds  for  definition  (2.1).  Property 
P,.  holds  for  definition  (2.2),  by  application  of  the  Helly-Bray  theorem. 

We  will  show  that  the  three  definitions  (2.1),  (2.2),  and  (2.3)  are 


equivalent.  Our  plan  for  the  proof  will  be  to  show  that  association 
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accordlng  to  (2.3)  implies  association  according  to  (2.2),  and  then  to 
show  that  association  according  to  (2.2)  implies  association  according  to 

(2.1) .  That  association  by  (2.1)  implies  association  by  (2.3)  is 
immediate,  since  property  holds  for  (2.1),  and  each  binary  Indicator 
X^(t)  is  a  non-decreasing  function  of  T^.  Given  that  definitions  (2.1), 

(2.2) ,  and  (2.3)  are  equivalent,  it  follows  that  properties  P^,  P2,  P^» 
P^,  and  P^  hold  for  each  of  the  definitions ,  since  each  property  has 
been  shown  to  hold  for  at  least  one  definition. 

Theorem  2.1.  If  T^,T2,...»Tn  are  associated  according  to 
definition  (2.3),  then  Cov[U(T) ,V(T) ]  ^0  for  all  pairs  U,V  of 
bounded,  continuous 3  non-decreasing  functions. 

Proof .  Since  we  can  add  large  enough  constants  to  each  of  a  pair 
of  bounded  functions  to  make  them  non-negative  without  changing  their 
covariance,  it  suffices  to  prove  the  theorem  for  pairs  U,V  of  non¬ 
negative,  bounded,  continuous,  non-decreasing  functions. 

Since  the  binary  random  variables  in  the  array  £(£)  »  (X^(tj); 
i"l, . . . ,n,j«l, . . . ,k}  are  associated  according  to  (2.1), 

CovtFJC^  »&}((£) ]  >_  0,  for  any  pair  F,G  of  non-decreasing  functions 
(by  our  previous  observation  that  definition  (2.1)  implies  definition 
(1.1)  in  the  finitely  discrete  case). 

Consider  some  choice  of  t^  <  tj  <•••<  t^.  anc*  ^e^ine*  e*S*  f°r 
U,  F(k)(T)  -  0  if  any  X^t^  -  0,  i-l,...,n;  F(k)(T)  -  U(£) ,  where 
S^  ■  max{tj  |X^(tj  )»1) ,  if  all  X^(t^)  ■  1.  The  functions  F^  are 
non-negative  and  non-decreasing ,  viewed  either  as  functions  of  T  or  as 
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functlons  of  £(£) .  Now  let  {t^.tj. • • . .t^}  Increase  with  k  to 
a  countable,  dense  set  In  (-«,+»).  Since  U,V,  and  U  •  V  are 
continuous,  0  <  F(k)  t  U,  0  <  G^k*  +  V,  and  0  <_  F(k)  •  G(k)  t  U  •  V 
at  each  fixed  value  of  T.  Since  U,V,  and  U  •  V  are  bounded,  by 
monotone  convergence  EF^(£)  +  EU(JT),  EG^(T)  +  EV(T),  and 
EF(k)(T)  •  G(k)(£)  t  EU(T)  •  V(T).  Thus  0  £  Cov[F(k)  (T)  ,G(k)  (T)  ]  -*• 
Cov[U(T),V(T)]. 

Lemma  2.2.  If  T.^,...,^  are  associated  according -to  definition 
(2.2),  then  Cov[$  (T)  ,¥(£)  ]  >_  0  for  all  pairs  ♦,4'  of  binary,  right 
continuous,  non-decreasing  functions. 

Proof .  Consider  e.g.  4>.  Let  A  *•  {jt 1 4>(t)-l) .  Let  d(,t,A)  be  the 

(k) 

Euclidean  distance  from  a  point  £  to  the  set  A.  Define  U  (£)  *0 

if  d(T,A)  >_  1/k,  U(k)(T)  -  1  -  k  •  d(T,A)  if  d(T,A)  <  1/k.  Each 

(k) 

function  U  is  non-negative,  bounded ,  continuous,  and  non- decreasing. 

(k) 

Since  4>  is  right  continuous,  A  is  closed.  We  have  U  (t)  ■  1,  if 
t,  e  A,  all  k,  and  U^(t)  V  0,  as  k  ■+•  ®,  if  £  e  AC.  Thus 
1  _>  *  4>,  as  k  -*•  <*>. 

As  in  Theorem  2.1,  by  monotone  convergence,  we  conclude  that 
Cov[*(TM(T)]  >  0. 

Theorem  2.3.  If  Ti*T2',,,,Tn  are  a88°°^ai'e^  according  to  definition 
(2.2),  then  T^^,...,^  are  associated  according  to  definition  (2.1). 

Proof.  Consider  e.g.  T.  Let  A  ■  {£|r^t)"l}.  We  can  a 
compact  set  CCA  such  that  P[C]  +  £  >  P[A].  Let 

C+  ■  {c  +  t  |c  e  C, t,  >  0, . . .  ,t  >0}.  Then  C  C  C+  C  A  and  C+  is  closed. 
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Let  ♦  <£)  -  1  if  J  e  C+,  *(T)  -  0  if  T  e  (C+)C.  The  function  t 
is  binary ,  right  continuous ,  and  non-decreasing ;  r  >_  $;  and 
E*(T)  +  e  >.  Er(T).  Thus  Cov[r(T)  ,A(T)] 

>_  E*(T)¥(£)  -  { E4> (T)  +  e}*{EY(£)  +  e}  >_  Cov [ <t> (T) , ¥ (J£) ]  -  2c  -  c2 . 
Letting  e  -*■  0  and  using  Lemma  2.2,  we  obtain  Cov[r(£) , A (JT ) ]  >_  0. 


3.  The  covariance  of  arbitrary,  non-decreasing  functions 

We  now  prove  a  theorem  which  indicates  that  we  could  define  association 
for  general  random  variables  in  essentially  the  same  way,  i.e.  by  (1.1), 
that  we  defined  it  for  finitely  discrete  random  variables. 

Theorem  3.1.  If  T.^,^ . T^  are  associated  and  F,G  are  a  pair 

of  non-decreasing  functions  such  that  EF(T)  ,  EG (T) ,  and  EF(T)G(T)  exist , 
then  Cov[F(£),G(T)]  >_  0. 

Proof.  That  T^,T2 , . . . ,Tn  are  associated  implies,  by  P^,  that 
F^T),  GQ)  are  associated,  which  in  turn  implies,  by  P^,  that 
Xp(s),  Xg(t)  are  associated  for  all  s,  t,  where  e.g.  Xp(s)  *  1  if 
F(T)  >  s,  XE,(s)  -  0  if  F(T)  <  s.  Thus  Cov[X_(s)  ,X_(t) ]  >  0,  all  s,  t. 
The  result  follows  from  the  identity 


(3.1)  Cov[F(T),G(T)]  •  J  f  Cov[XF(s),XG(t)]ds  dt. 


—00  —00 


[See  Lehmann  (1966),  who  gives  a  convenient  statement  of  (3.1)  and  a 
proof  attributed  to  W.  Hoeffding.  See  also  Marshall-Olkin  (1966)  for 
a  comparable  result  on  moment  generating  functions.] 


-7- 


4.  Applications 

Several  interesting  applications  may  be  obtained  as  a  consequence 
of 

Theorem  4.1.  Let  T,  ,T„ . T  be  associated.  Then 

-  12’  n 

(4.1a)  PITj  <  trT2  <  t2 . Tn  <  tn]  >  TT".!  <, 

and 

(4.1b)  ?[T1  >  t1,T2  >  t2,...,Tn  >  tn]  >  TT"ml  P[Ta  >  t1], 

for  all  t^,t2, . . . ,t  . 

Proof.  Let  X^(t^)  *  1  if  T^  >  t^.  Then  the  binary  random 
variables  X^(t^)  ,X2(t2) , . . .  .X^Ct^)  are  associated  by  P^,.  Using 
(2.3.2)  and  (2.3.1)  of  [1]  we  obtain  (4.1a)  and  (4.1b), 
respectively. 

Partial  sums  [Robbins  (1954)] 

Let  T^,T2,...,Tn  be  independent  random  variables.  Then  T^,T2»...,T 

are  associated  by  an<*  ^3*  Let  ^  T^,  j=l,...,n.  Then 

SiySot...,S  are  associated  by  P, .  Thus 
1  2’  n  4 

P[SX  — -  s2 ’  *  *  *  *^n  — ■  SrJ  —  I  Tj Pt®j  L.  ® 1 

for  all  s^,s2»...,sn  by  (4.1a). 
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Order  statistics 

Let  T, ,T0,...,T  be  a  sample  of  size  n,  and  S.  ,S0 , . . .  ,S 
l  &  n  i  i  n 

be  the  corresponding  order  statistics.  Then  T^,T2,...,Tn  are 
independent  and  thus  associated  by  P2  and  P^*  Since  each  is 

a  non-decreasing  function  of  T^^, . . .  ,1^,  S^,S2»...,Sn  are 

associated  by  P^.  Thus  (4.1a)  and  (4.1b)  hold  for  S^,S2»*>»»S  , 
and  by  P^  also  for  every  subset  of  . . .  ,Sn> 


Multivariate  exponential  distribution 

Marshall  and  Olkin  (1966)  consider  the  multivariate  exponential 

distribution  with  the  distribution  function  F(s, ,s0 , . . . ,s  )  such  that 

1  1.  m 


(4.2)  1  -  F(s1,s2>. . . ,sm) 


exp[->  A  s  -  >  A  max(s  ,s  ) 
^j-1  J  J  ^j<k  Jk  J  k 


— A ■  rj  max ). 

12 .  .  .m  12  m 


As  pointed  out  by  Marshall  and  Olkin  if  random  variables 

are  distributed  according  to  (4.2),  then  there  exist  independent, 

exponentially  distributed  random  variables  T^,T2»...,Tn  such  that 

S  =  min(T.;i  c  A.),  where  A,  C  {1,2,. ..,n}.  Since  T,,T0,...,T 
J  1  J  j  1  z  n 

independent  and  each  Sj  is  a  non-decreasing  function  of  T^,T2,.. 
we  obtain  from  Theorem  4.1 


are 
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(4.3a) 


F(s1,s2,, 


-  TT-”  x  VV 


and 


(4.3b) 


m 


1  - 


F(s1#s2, 


*s_ ) 
m 


>ff  [l-F  (a  )], 

1-1  2  2 


where  Fj  is  the  marginal  distribution  function  of  S  ^  .  Marshall  and 
Olkin  discuss  inequalities  (4.3a)  and  (4.3b)  for  the  bivariate  exponential, 
and  give  a  further,  quantitative  analysis  of  that  case. 


Analysis  of  variance 

Kimball  (1951)  considers  the  case  of  analysis  of  variance  in  which 

two  hypotheses  are  tested  using  the  same  error  variance  for  each  test.  As 

an  example  of  particular  importance,  he  cites  the  case  in  which  the  effects 

of  both  rows  and  columns  are  to  be  tested.  As  usually  formulated,  three 

quadratic  forms,  q^,  q2>  q^,  are  computed,  independently  distributed  as 
2 

X  with  n. ,  n„,  n„  degrees  of  freedom  respectively,  q,  representing 

1  X  J  X 

the  sum  of  squares  between  rows,  q2  the  sum  of  squares  between  columns, 
and  q^  the  sum  of  squares  due  to  error.  The  likelihood  ratio  test 
statistics  for  testing  the  two  hypotheses  are 

q-,  /n1  q2/n- 

p  „  and  F  =  -A-  f  . 

1  ^  23/113 

The  probability  of  making  no  errors  of  the  first  kind  is 
P[Fi  <  Fla,F2  <  F  ],  where  Fla(F2a)  is  the  100a  per  cent  point  of  the 
distribution  of  F^(F2).  Kimball  proves 
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(4.4)  P[Fl  <  Fla,F2  <  F2q]  >  P[Fl  <  Fla]P[F2  <  F2J  . 

In  other  words,  the  assurance  of  no  errors  of  the  first  kind  is  greater 
following  the  standard  experimental  procedure  than  if  separate  experiments 
had  been  performed. 

Kimball's  result  is  an  immediate  consequence  of  Theorem  4.1  if  we 
note  that  q^,  q2,  q^  are  associated  (since  independent),  and  F^, 
are  non-decreasing  functions  of  q^,  q2»  q^. 
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